an. 


13] Ovs.'J^r- iL ne.ura.L nefcoh- 1 < oP- Uli+L 

lA-pwlr oUa. fkHern- (Xl .Xi) Output- s 

S . 1 1 Aeuyvn-S o I- the hidden. oJld OubpLcbr JLaAje^% 

P^du.C£ binary hky^skold 'S'^jneJ S. Ffhcl tie l/aH'da-S 
We^lits o£ rke ndruJork ^litk fktr ft ieVe^ O.S 
a tu)o- ckK cbxsSibtY' ~buJo Sep a ytd~‘'d n. 

b{\ez ^hooJ/L ^ Tf\Z~poin~hs (Jithi'n. tii*, hdz LI 

y^i\jrx are id&ntifii'eJ by S = 0 ^ OnJ ~tk^ pci'ntrs 
Oufcs'ld-C dks y&Jj'aa ane 1 'derihfreJl log S= 1 . UmJ 
U)ill tke~ 1 npd—ckta patterns ( Q S o.s) (o&J^ 

( & J 2-X cuJ (o-g J !-s) ie class tPieJ ? 
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1-5 

s Xa. 

/ /Ai-5 

vW/// 



V///Y 

^ / 

/ / / 

f- ; g. H ’Sepa.yvzh'o/l- j2\ 

/ 

aes P^P 



r<A.' v 1 ^ ' ^ 

/\LL f)zaron- S <$£ ~&t- h'dden- ctflA o ofp 

du.ce binary ~thresholcl ’SCjncdS- Fi'neJ 

4t5 of rAe f&ukrk suck -tkcfrh 
«tcjo- class dah cUniW^.y' Ui+k ^ 

*s sU„v. 

irch-ed re*; on. *Ke l dent M if 

^5 odriie ^ ^f.n. ^ 

leu, will -tie fnjxtr data fvM 

\eSSi ? 

til) (- 1 ,- 1 ) ( l 2 -q) 




Problem 2 1 

Consider the neural network of. Fig. 3 , coith an input 

data, pattern x 2 ) and an output signal S.. All 

neurons o f the hidden and output lagers produce 
^binary threshold, signals • The numerical ... values . of - 
the bias weights and . -k£ are 1.0 and 0.8, 

— respectively. Find the various.- weights of the 
— n etcjork _ such that it -behaves -.as a two- class— data 

— classifier With the separation -lines shown in Fig - 

— 7 he -poin ts uii thin - the _ hatched region are identified 

— bgS-^-l-y— and. -th e- points outside this region are .... 

— identified by S - O . How will . the input data. 

patterns (2 J O) , (2, 4) > (-H, h-) , and (-4, - S.) be 

— classified ? _■ 



Solution 


The first separation line [ passing through points (-2,2) 
-a.ncl.—(rm.3. J Jt) J - is 



j 22~) (2>nS\Ae^ ^etoJo kJ< oP cj/V/lQ^ )np<J& 

Acda pdbvrn. ^ Motkp'jr Srjtois. /)D 

ficunn 5 1L. fh'Jlcle^ outftir by^s p^oUc e 

binarj threshold ZijncJs.'Tfe riamon'cdL Val^S *Hh*- 
bias iMjkhs Cd a j and (Jqlj o*7- and o,Lj j Yes^ckeLj. 
find dhe Various UJ&iyhhr s of d~ke_ nekujovp 'S’uzl^ -fh^fc- 
)’ t btha\/-es aS cti^o - cl^ss dodo. claSSi Pi&r Cc/ijj)bh^ 
^epxvafio/) Lv?e-s ’shooJ/) if\ s'~IPue. poinbs UJ\ Hyih 

4)^ biatrcb^d ^‘ dn are Cdzyib £* egl a/id 

y/>£ 'po.'nfs (Xd^Sicl e -tfv* ^ <‘cles\ttfteeA ttj 

S=<j. Hou UlU l -^C < n P^ ^ Patterns ^0), 

(^3); (n.-z) ; ^2y-0 ciosSiif'eJ ? 


/a- 



Problem 2 3 


Slf 


-The neural network. of has an input data pattern 

Cxi>oc 3 ) and an output signal S. AH neurons of the 
— kicl Jen and output layers produce kinary . threshold 
— signals — The weight values are : 

- 1 ' *£j--= °- s - - 

• - - 0 . 5 * 


w /3 
Txr,. O 


-%r lC -jz-. o. 2 , 


W" =O.S 
03 

'uf - c/. S' 

- 

tiT ..=■ 
os 

. fcT - 2 


% £7 W - ^ * 5 ^ —ST 2 

W- - . 1 ; 

w " 46 6-6 

W — =- o.S' 

— Shout — that. -the -network can hehave qs a. two^class 


data -classifier on the x 1 -oc^ plane cohere _ all 

p omts _ with in _ $ riangl e with- vertices (1,1)-,- _ 

(2, 3) y and — <ar<? identified log S — O p 4 /ocZ 

all— points outside this triangle, are i dentified 

by s = 1 . 

lou)-U)ill - the — input- data patterns ( 2 , 2) ? (2; *2).,.. 

(- - 1 7 l'S) , and (S, 3) he class] f i ed ? 



XH j ConSi'o \eY~ TtcuMxL- fidd Jork 5 f- Fi' ^ , §> ^ 

uifk. an- ifiputr clota Portbem X 2) ccnd an 

oJTp ut~ ' 5 >jnod £ . pill Yleayan S “&*- hidden, 
find drfrpdtr i^erS p^c/aCe \)Cnaypj "threshold 

^JJnA-Ls - iJn-e kMj'jktr l/d/o^S ; 

OJ, S = 0,3 , Ula3 = -rf' 7 - ^ ^3 ^ 0,2 

^ M - 0 s ^2°! —I 2 =s 1 

kr i5 ^0-2^ ^ LS25 - G ^ UJeg as ~ 1 

^06 ~ - 1*3 , , , 1 

a) ishovJ dhotr fhe network Can behave cl S 4 

data, class iP‘'er~ on bine X1-X2 P lane ^ Uh&r*. att pbrtebs 

UJitui'^ CLSpedhc tojkt- angled i^anjU 4y&Z(Urtt*d 
bj oA-dl a// points od^SiJe bfn's [c 

ar<L J dtritifi'ej by S=>o. 

\d) Determine the. VerbrosS ab Th-e. tr< anj[ / e Y&jbrred l& 
in. part P & 3 * 

cj ujkat bjie Ofejrotncn 1 s performed bnj n-e^irn 
g~ an rtc. przjaeed ^Wn§ 2, 

J) HaoJ i^’ll ih^inpd^ ddra pcrfkm s ^ 0 ) ^ 
t L l‘ 5 ,o)^ and (j -36 J ]■ 7 - ) te 

d-4,£>S * A ej J 



Problem 25 . 


- Consider the neural netioork of Fig * <9 ^ ujith..an.in put _ 

data, pa ttern, (at, A : 2 ) .and an . output _ ..signal A ll 

neurons of . the hidden ..and output layers -.produce 

binary threshold .signals Find the various weights of 

the netujork such that it he have s as .a.. tcuo.~ class 

data, classifier . All points co/thin the triangle . shousn 

in Fig. 3 are .identified . by S - O, and all. points 

outside this triangle are identified hyj S = 1 TTe. _ 

numeric**! value of _ any ..bias coei ght should not . — 


exceed l.S .. .Hoco .uJi.il the input data patterns (0, 0) ^ . 



Solution 

The ... first separation line £ passing through points (.0,1+) 
and iS . 

* 2-4 _ - 4-4 

x, - O -3-o 

3 ~ 8 Xi t 12 — - — 


or_ 



*7 


_ Problem 2^7 

C <*) State- a mathematical formula. jor calculating the 

- "umber oj linear dichotomies that can- he 

induced- on p points (.in general, position) in 

an n-dimensional space , . L (f>,n) 

Use tbe formula oj part (a) to shoco that 

- - L £<h a) - 5 — L (4,2) 2. , 

(c) ln~-vi.eiAj . of tin e result- of part (h) > . .. shouj-that 

tine, logic ...X OR. junction can toe implemented.log.. 

the ..neural . network - oj ... Fig, IO .where tin e 

space dimension - increases jrom- 2 to -3 .Specif u _ 

the- role played - hg neuron 3 ? and determine 

— -the— -various -00 eights, oj. the network 

U) in part Cc) , portray the separation plane ; n . 

the 3-dimensional — space. Comment on this 

situation jrom the d 1 chotomi zation vieu> point .. 



^3 ' 10 F e oral network jor Pro lo- 21 - part i 


— Solution 

— (a) -.The. mathematical jormula jor L(p >n ) 



is . 



2 I) ^ e f >ea i Pfob- 25 ujhen__ ~~Hxe- ori&-nf' a ,J') a n-S 

6 pi ike. TSePcxy-ccti'an. h/)e% a/£- fe Vet'S^c] - 


In JouK 
the. Yejia^ 

a) X 3 = 0 


3 „u^ »£ p-k. 2 ?, r^-t isyr^A, 

ofi inpdr poct't e ^ nS '*' 1 ) far oAtcA; 


A) Xs = 1 

cj) Xj — o *svd S = 0 


J) X$ = a and 5=1 
e) X$ - i ana) S3 0 
{.) X 3 * 1 and s - 1 

5 ) S=o 

K) s- 1 


2j%«t /w*» (A) w<aj 

p,t. 2 S gr-tk^lyc 
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